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I. INTRODUCTION 

This paper describes a higher-resolution calculation of a similar calculation performed in a recent 
paper [1], using supercomputer resources not available at that time, and are of the quality of resolution 
presented in a different system using the same path-integral code PATHINT [2]. A more detailed 
description of the theoretical basis for these calculations can be found in that paper, and in previous 
papers in this series of statistical mechanics of neocortical interactions (SMNI) [3-18]. 

The SMNI approach is to develop mesoscopic scales of neuronal interactions at columnar levels of 
hundreds of neurons from the statistical mechanics of relatively microscopic interactions at neuronal and 
synaptic scales, poised to study relatively macroscopic dynamics at regional scales as measured by scalp 
electroencephalography (EEG). Relevant experimental data are discussed in the SMNI papers at the 
mesoscopic scales, e.g., as in this paper's calculations, as well as at macroscopic scales of scalp EEG. 
Here, we demonstrate that the derived firings of columnar activity, considered as order parameters of the 
mesoscopic system, develop multiple attractors, which illuminate attractors that may be present in the 
macroscopic regional dynamics of neocortex. 

The SMNI approach may be complementary to other methods of studying nonlinear neocortical 
dynamics at macroscopic scales. For example, EEG and magnetoencephalography data have been 
expanded in a series of spatial principal components (Karhunen-Loeve expansion). The coefficients in 
such expansions are identified as order parameters that characterize phase changes in cognitive 
studies [19,20] and epileptic seizures [21,22], which are not considered here. 

The calculations given here are of minicolumnar interactions among hundreds of neurons, within a 
macrocolumnar extent of hundreds of thousands of neurons. Such interactions take place on time scales 
of several t, where t is on the order of 10 msec (of the order of time constants of cortical pyramidal 
cells). This also is the observed time scale of the dynamics of short-term memory. We hypothesize that 
columnar interactions within and/or between regions containing many milhons of neurons are responsible 
for phenomena at time scales of several seconds. 

That is, the nonhnear evolution as calculated here at finer temporal scales gives a base of support 
for the phenomena observed at the coarser temporal scales, e.g., by establishing mesoscopic attractors at 
many macrocolumnar spatial locations to process patterns at larger regions domains. This motivates us to 
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continue using the SMNI approach to study minicolumnar interactions across macrocolumns and across 
regions. For example, this could be approached with a mesoscopic neural network using a confluence of 
techniques drawn from SMNI, modem methods of functional stochastic calculus defining nonlinear 
Lagrangians, adaptive simulated annealing (ASA) [23], and parallel-processing computation, as 
previously reported [16]. Other developments of SMNI, utilizing coarser statistical scaling than presented 
here, have been used to more directly interface with EEG phenomena, including the spatial and temporal 
filtering observed experimentally [14,15,17,18]. 

Section II presents a current experimental and theoretical context for the relevance of these 
calculations. We stress that neocortical interactions take place at multiple local and global scales and that 
a confluence of experimental and theoretical approaches across these scales very likely will be required to 
improve our understanding of the physics of neocortex. 

Section III presents our current calculations, summarizing 10 CPU days of Convex 120 
supercomputer resources in several figures. These results support the original coarser arguments given in 
SMNI papers a decade ago [6,8]. 

Section IV presents our conclusions. 

II. EXPERIMENTAL AND THEORETICAL CONTEXT 

A. EEG studies 

EEG provides a means to study neocortical dynamic function at the milhsecond time scales at 
which information is processed. EEG provides information for cognitive scientists and medical doctors. 
A major challenge for this field is the integration of these kinds of data with theoretical and experimental 
studies of the dynamic structures of EEG. 

Theoretical studies of the neocortical medium have involved local circuits with postsynaptic 
potential delays [24-27], global studies in which finite velocity of action potential and periodic boundary 
conditions are important [28-31], and nonlinear nonequilibrium statistical mechanics of neocortex to deal 
with multiple scales of interaction [3-18]. The local and the global theories combine naturally to form a 
single theory in which control parameters effect changes between more local and more global dynamic 
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behavior [31,32], in a manner somewhat analogous to localized and extended wave-function states in 
disordered solids. 

Recently, plausible connections between the multiple-scale statistical theory and the more 
phenomenological global theory were proposed [14]. Experimental studies of neocortical dynamics with 
EEG include maps of magnitude distribution over the scalp [29,33], standard Fourier analyses of EEG 
time series [29], and estimates of correlation dimension [34,35]. Other studies have emphasized that 
many EEG states are accurately described by a few coherent spatial modes exhibiting complex temporal 
behavior [19-22,29,31]. These modes are the order parameters at macroscopic scales that underpin the 
phase changes associated with changes of physiological state. 

The recent development of methods to improve the spatial resolution of EEG has made it more 
practical to study spatial structure. The new high resolution methods provide apparent resolution in the 
2-3 cm range, as compared to 5-10 cm for conventional EEG [36]. EEG data were obtained in 
collaboration with the Swinburne Centre for Applied Neurosciences using 64 electrodes over the upper 
scalp. These scalp data are used to estimate potentials at the neocortical surface. The algorithms make 
use of general properties of the head volume conductor. A straightforward approach is to calculate the 
surface Laplacian from spline fits to the scalp potential distribution. This approach yields estimates 
similar to those obtained using concentric spheres models of the head [36]. 

Here we report on data recorded from one of us (P.L.N), while awake and relaxed with closed eyes 
(the usual alpha rhythm). The resulting EEG signal has dominant power in the 9-10 Hz range. We 
Fourier transformed the 64 data chaimels and passed Fourier coefficients at 10 Hz through our Laplacian 
algorithm to obtain cortical Fourier coefficients. In this manner the magnitude and phase structure of 
EEG was estimated. A typical Laplacian magnitude and phase plot for 1 sec of EEG is shown in Fig. 1 . 
This structure was determined to be stable on 1-min time scales; that is averages over 1 min exhibit 
minimal minute to minute changes when the psychological/physiological state of the brain is held fixed. 
By contrast, the structure is quasi-stable on 1-sec time scales. To show this we calculated magnitude and 
phase templates based on an average over 3 min. We than obtained correlation coefficients by comparing 
magnitudes and phases at each electrode position for one second epochs of data with the templates. In 
this maimer we determined that the structure is quasi-stable on 1 sec time scales. That is, correlation 
coefficients vary from second to second over moderate ranges, as shown in Fig. 2. Another interesting 
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aspect of these data is the periodic behavior of the correlation coefficients; magnitudes and phases 
undergo large changes roughly every 6 sec and then return to patterns that more nearly match templates. 

We have previously considered how mesoscopic activity may influence the very large scale 
dynamics observed on the scalp [14]. In some limiting cases (especially those brain states with minimal 
cognitive processing), this mesoscopic influence may be sufficiently small so that macroscopic dynamics 
can be approximated by a quasi-Hnear "fluid-Hke" representation of neural mass action [28-31]. In this 
approximation, the dynamics is crudely described as standing waves in the closed neocortical medium 
with periodic boundary conditions. Each spatial mode may exhibit linear or limit cycle behavior at 
frequencies in the 2-20 Hz range with mode frequencies partly determined by the size of the cortex and 
the action potential velocity in corticocortical fibers. The phase structure shown in Fig. 1 may show the 
nodal lines of such standing waves. 

B. Short-term memory 

SMNI has presented a model of short-term memory (STM), to the extent it offers stochastic bounds 
for this phenomena during focused selective attention [1,6,8,37-39], transpiring on the order of tenths of a 
second to seconds, limited to the retention of 7 ±2 items [40]. This is true even for apparently 
exceptional memory performers who, while they may be capable of more efficient encoding and retrieval 
of STM, and while they may be more efficient in "chunking" larger patterns of information into single 
items, nevertheless are limited to a STM capacity of 7 ±2 items [41]. Mechanisms for various STM 
phenomena have been proposed across many spatial scales [42]. This "rule" is verified for acoustical 
STM, but for visual or semantic STM, which typically require longer times for rehearsal in an 
hypothesized articulatory loop of individual items, STM capacity appears to be Umited to 4 ± 2 [43]. 

Another interesting phenomenon of STM capacity explained by SMNI is the primacy versus 
recency effect in STM serial processing, wherein first-learned items are recalled most error-free, with last- 
learned items still more error-free than those in the middle [44]. The basic assumption being made is that 
a pattern of neuronal firing that persists for many r cycles is a candidate to store the "memory" of 
activity that gave rise to this pattern. If several firing patterns can simultaneously exist, then there is the 
capability of storing several memories. The short-time probabihty distribution derived for the neocortex 
is the primary tool to seek such firing patterns. 
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It has been noted that experimental data on velocities of propagation of long-ranged fibers [29,31] 
and derived velocities of propagation of information across local miiricolumnar interactions [4] yield 
comparable times scales of interactions across miiricolumns of tenths of a second. Therefore, such 
phenomena as STM likely are inextricably dependent on interactions at local and global scales, and this is 
assumed here. 

III. PRESENT CALCULATIONS 



A. Probability distribution and the Lagrangian 

As described in more detail in a previous paper [1], the short-time conditional probability of 
changing firing states within relaxation time r of excitatory {E) and inhibitory (/) firings in a minicolumn 
of 110 neurons (twice this number in the visual neocortex) is given by the following summary of 
equations. The Einstein summation convention is used for compactness, whereby any index appearing 
more than once among factors in any term is assumed to be summed over, unless otherwise indicated by 
vertical bars, e.g., IGI. The mesoscopic probability distribution P is given by the product of microscopic 
probabihty distributions p„., constrained such that the aggregate mesoscopic excitatory firings M^= 
Xjefi '^i^ ^iid the aggregate mesoscopic inhibitory firings M^= Xje/ '^j- 

P=Yl P^[M^{r;t + T)\M^{r';t)\ 

G=E,I 



\ f 
5 



i^i j 



- n (2;rTg^^)-i'2 exp(-A^TLG) , (1) 

G 

where the final form is derived using the fact that A'^ > 100. G represents contributions from both E and / 
sources. This defines the Lagrangian, in terms of its first-moment drifts g , its second-moment diffusion 

matrix g^^ , and its potential V', all of which depend sensitively on threshold factors F^, 

P-^ilTtT)-^'^ g^'^ expi-NrL) , 
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G 



g''''' = iSGG'T' = ^V^A^^sechV^ , 



g = det(gGG') > 



F^ = ^ 



«g' = ^^g' + Sg'' (2) 

where Aq, and Bq, are macrocolumnar-averaged intemeuronal synaptic efficacies, Vq> and are 
averaged means and variances of contributions to neuronal electric polarizations, and nearest-neighbor 
interactions V' are detailed in other SMNI papers [4,6]. and in are afferent macrocolumnar 
firings, scaled to efferent miiricolumnar firings by N/N*~10~^, where A^* is the number of neurons in a 
macrocolumn. Similarly, Aq and Bq have been scaled by N*/N~10^ to keep F^ invariant. This scaling 
is for convenience only. For neocortex, due to chemical independence of excitatory and inhibitory 
interactions, the diffusion matrix g'^^ is diagonal. 

The above development of a short-time conditional probability for changing firing states at the 
mesoscopic entity of a mesocolumn (essentially a macrocolumnar averaged minicolumn), can be folded in 
time over and over by path-integral techniques developed in the late 1970s to process multivariate 
Lagrangians nonlinear in their drifts and diffusions [45,46]. This is further developed in the SMNI papers 
into a full spatial-temporal field theory across regions of neocortex. 
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B. PATHINT algorithm 

The PATHINT algorithm can be summarized as a histogram procedure that can numerically 
approximate the path integral to a high degree of accuracy as a sum of rectangles at points M,- of height P,- 
and width AM,. For convenience, just consider a one-dimensional system. The path-integral 
representation described above can be written, for each of its intermediate integrals, as 

P{M; t + M)=\ dM'[g^J^{2jtKtr^''^ exp(-L,AO]P(M'; t) 



j dM'G{M, M'; At)P{M'; t) , 



P{M;t) = Y.K{M-Mi)Pi{t), 
i=l 



7i{M - Mi) = ■ 



1 , {Mi - ^ AM,_i) <M<{Mi+^- AMi) , 
0, otherwise. 



(3) 



This yields 



Pi(t + At) = Tij(At)Pj(t), 



TiiiAt) = ^ f ^i+AM,/2 [ '^j+^^ji'^ dM'G{M, M'; At) . (4) 

AM,-_i -I- AM; J Mi-t^Mi^ill J Mj-AMj.i/2 

Tjj is a banded matrix representing the Gaussian nature of the short-time probability centered about the 
(possibly time-dependent) drift. Care must be used in developing the mesh in AM*^, which is strongly 
dependent on the diagonal elements of the diffusion matrix, e.g., 

AM*^ = (A?g'^"^V^2 _ (5) 

Presently, this constrains the dependence of the covariance of each variable to be a nonlinear function of 
that variable, albeit arbitrarily nonHnear, in order to present a straightforward rectangular underlying 
mesh. 
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A previous paper [1] attempted to circumvent this restriction by taking advantage of previous 
observations [6,8] that the most likely states of the "centered" systems lie along diagonals in M*^ space, a 
line determined by the numerator of the threshold factor, essentially 

Af - Af = , (6) 

where for neocortex Af is on the order of Af . Along this line, for a centered system, the threshold factor 
~ 0, and is a minimum. However, looking at , in the numerator (A^M^ - A/M ^) is 
typically small only for small M^, since for the neocortex A\ <K Ag. 



C. Further considerations for high-resolution calculation 

However, several problems plagued these calculations. First, and likely most important, is that it 
was recognized that a Sun workstation was barely able to conduct tests at finer mesh resolutions. This 
became apparent in a subsequent calculation in a different system, which could be processed at finer and 
finer meshes, where the resolution of peaks was much more satisfactory [2]. Second, it was difficult, if 
not impossible given the nature of the algorithm discussed above, to disentangle any possible sources of 
error introduced by the approximations based on the transformation used. 

The main issues to note here are that the physical boundaries of firings = are imposed by 
the numbers of excitatory and inhibitory neurons per minicolumn in a given region. Physically, firings at 
these boundaries are unlikely in normal brains, e.g., unless they are epileptic or dead. Numerically, 
PATHINT problems with SMNI diffusions and drifts arise for large M*^ at these boundaries: 

(a) SMNI has regions of relatively small diffusions g^^ at the boundaries of space. As the 
AM*^ meshes are proportional to (g'^'^ A?)^'^, this could require PATHINT to process relatively small 
meshes in these otherwise physically uninteresting domains, leading to kernels of size tens of millions of 
elements. These small diffusions also lead to large Lagrangians which imply relatively small 
contributions to the conditional probabilities of firings in these domains. 

(b) At the boundaries of M space, SMNI can have large negative drifts, g . This can cause 
anomalous numerical problems with the Neumann reflecting boundary conditions taken at all boundaries. 

For example, if g'^Af is sufficiently large and negative, negative probabilities can result. Therefore, this 
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would require quite small A? meshes to treat properly, affecting the AM*^ meshes throughout space. 
A quite reasonable solution is to cut off the drifts and diffusions at the edges by Gaussian factors F, 

exp[-(M^/A^^)^/C] - exp(-l/C) 
jLii l-exp(-l/C) 

where C is a cutoff parameter and the second term of the transformed diffusion is weighted by N^k, the 
value of the SMNI diffusion at M'^ = 0. A value of C = 0. 2 was found to give good results. 

However, the use of this cutoff rendered the diffusions approximately constant over the E and the / 
firing states, e.g., on the order of A'^*^. Therefore, here the diffusions were taken to be these constants. 

While a resolution of Af = 0. 5r was taken for the previous PATHINT calculation [1], here a 
temporal resolution of A? = 0. OIt was necessary to get well-developed peaks of the evolving distribution 
for time epochs on the order of several t. As discussed in the Appendix of an earlier paper [6], such a 
finer resolution is quite physically reasonable, i.e., even beyond any numerical requirements for such 
temporal meshes. That is, defining 9 in that previous study to be Af, firings of M {t + Af) for < A? < r 
arise due to interactions within memory -r as far back as M*^(? -I- A? - 1). That is, the mesocolumnar unit 
expresses the firings of afferents M -I- -r) at time t + t as having been calculated from interactions 
M^(t) at the r-averaged efferent firing time t. With equal likelihood throughout time t, any of the A^* 
uncorrelated efferent neurons from a surrounding macrocolumn can contribute to change the 
minicolumnar mean firings and fluctuations of their uncorrelated minicolumnar afferents. Therefore, 
for At < T, at least to resolution At > rlN and to order Atlt, it is reasonable to assume that efferents effect 
a change in afferent mean firings of AtM^ = M^(t + At) - M*^(?)=A?g*^ with variance Atg^^. Indeed, 
columnar firings (e.g., as measured by averaged evoked potentials) are observed to be faithful continuous 
probabihstic measures of individual neuronal firings (e.g., as measured by poststimulus histograms) [47]. 

When this cutoff procedure is applied with this temporal mesh, an additional physically satisfying 
result is obtained, whereby the AM^ mesh is on the order of a firing unit throughout space. The 
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interesting physics of the interior region as discussed in previous papers is still maintained by this 
procedure. 

D. Four models of selective attention 

Three representative models of neocortex during states of selective attention are considered, which 
are effected by considering synaptic parameters within experimentally observed ranges. 

A model of dominant inhibition describes how minicolumnar firings are suppressed by their 
neighboring minicolumns. For example, this could be effected by developing nearest-neighbor 
mesocolumnar interactions [5], but the averaged effect is estabhshed by inhibitory mesocolumns (IC) by 
setting = Af = 2Af = 0. 01N*/N. Since there appears to be relatively little / — / connectivity, we set 
A'i = 0. 0001A^*/A^. The background synaptic noise is taken to be Bf = B'e = 2Sf = lOS^ = 0. 002N*/N. 
As minicolumns are observed to have -110 neurons (the visual cortex appears to have approximately 
twice this density) [48] and as there appear to be a predominance of E over / neurons [29], we take 
A^^ = 80 and A^^ = 30. As supported by references to experiments in early SMNl papers, we take 
N*/N = 10^ Jg = (absence of long-ranged interactions), = 10 mV, Ivg.l = 0. 1 mV, and = 0. 1 
mV. It is discovered that more minima of L are created, or "restored," if the numerator of contains 
terms only in M , tending to center the Lagrangian about M = 0. Of course, any mechanism producing 
more as well as deeper minima is statistically favored. However, this particular centering mechanism has 
plausible support: M^{t -I- r) = is the state of afferent firing with highest statistical weight. That is, 
there are more combinations of neuronal firings cry = ±1 yielding this state more than any other 
M'^it + t); e.g., ~2^''+'^'^{n:N'^)~^'^ relative to the states = ±A^'^. Similarly, M*'^(t) is the state of 
efferent firing with highest statistical weight. Therefore, it is natural to explore mechanisms that favor 
common highly weighted efferent and afferent firings in ranges consistent with favorable firing threshold 
factors F^^O. 

The centering effect of the IC model of dominant inhibition, labeled here as the iC model, is quite 
easy for the neocortex to accommodate. For example, this can be accomplished simply by readjusting the 
synaptic background noise from sf to S'f , 
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-{-A^'+ Bf)v'^'N' - - aIv^^N^ 
B'l = ^ gTTH (8) 



for both G = E and G = I. This is modified straightforwardly when regional influences from long-ranged 
firings M*^ are included [15]. In general, sf and (and possibly Af and due to actions of 
neuromodulators and Jq or M*^ constraints from long-ranged fibers) are available to force the constant in 
the numerator to zero, giving an extra degree(s) of freedom to this mechanism. (If B'f would be negative, 
this leads to unphysical results in the square-root denominator of . Here, in all examples where this 
occurs, it is possible to instead find positive B'f to appropriately shift the numerator of .) In this 
context, it is experimentally observed that the synaptic sensitivity of neurons engaged in selective 
attention is altered, presumably by the influence of chemical neuromodulators on postsynaptic 
neurons [49]. 

By this centering mechanism, the model Ffr' is obtained 



- 



0.51/' 0.251/' 



;ri^2(o. iM^ + 0.05M^ + 10. 4)1/2 ' 



He = J F ■ (9) 

;ri/2(0.001M -HO. IM -^20.4)1/2 



The other "extreme" of normal neocortical firings is a model of dominant excitation, effected by 
estabUshing excitatory mesocolumns (EC) by using the same parameters { Bq', Vq', ^q', A\ } as in the 
IC model, but setting Af = 2A|- = 2Af = 0. 01A^*/A/. Applying the centering mechanism to EC, 
B'f = 10. 2 and B'\ = 8. 62. This yields 

E 0.25m' -0.5M^ 



;r 1/2(0. 05 + 0. lOM^ + 17. 2)i/2 ' 



, 0. 005M^ - 0. 25M^ 

He = ^ • (10) 

;r 1/2(0. OOIM^ + 0. 05M^ + 12. 4)1/2 
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Now it is natural to examine a balanced case intermediate between IC and EC, labeled BC. This is 
accomplished by changing A^ = = Af = 0. 005N*/N. Applying the centering mechanism to BC, 
S'l = 0. 438 and B''j = 8. 62. This yields 



E 0.25M^-0.25M^ 



;ri/2(o.050M^-h0.050M'-h 7. 40)1/2 ' 



, 0. 005M^ - 0. 25M^ 

Fir = —, ^ • (1 1) 

;r 1/2(0. OOIM^ + 0. 050M^ + 12. 4)1/2 

A fourth model, similar to BC', for the visual neocortex is considered as well, BC'_V1S, where N'^ 
is doubled. 

E 0.25M^-0.25M^ 

Fur' 



BC'-Vis ^1/2(0. 050M^ + 0. 050M^ + 20. 4)i/2 



, 0.005M^-0.25M^ 

BC'-Vis ^1/2(0. ooIm' + 0. 050M^ + 26. 8)i/2 ' 



E. Results of calculations 

Models BC, EC, and IC were run at time resolutions of At = 0. 01 t, resulting in firing meshes of 
AM^ = 0. 894427 (truncated as necessary at one end point to fall within the required range of ±N^), and 
am' = 0. 547723. To be sure of accuracy in the calculations, off-diagonal spreads of firing meshes were 
taken as +5. This lead to an initial four-dimensional matrix of 179 xl 10x11x11 = 2 382 490 points, 
which was cut down to a kernel of 2 289 020 points because the off-diagonal points did not cross the 
boundaries. Reflecting Neumann boundary conditions were imposed by the method of images, consisting 
of a point image plus a continuous set of images leading to an error function [50]. A Convex 120 
supercomputer was used, but there were problems with its C compiler, so gcc version 2.60 was built and 
used. Runs across several machines, e.g., Suns, Dec workstations, and Crays, checked reproducibility of 
this compiler on this problem. It required about 17 CPU min to build the kernel, and about 0.45 CPU min 
for each A?-folding of the distribution. 
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For model BC'_V1S, the same time resolution and off-diagonal range was taken, resulting in firing 
meshes of = 1.26491 and AM^ = 0. 774597, leading to a kernel of size 4 611 275 elements. It 
required about 34 CPU min to build the kernel, and about 0.90 CPU min for each A? folding of the 
distribution. 

An initial <5-function stimulus was presented at = = for each model. The subsequent 
dispersion among the attractors of the systems gives information about the pattern capacity of this system. 
Data was printed every 100 foldings, representing the evolution of one unit of r. For run BC, data were 
collected for up to 50r, and for the other models data were collected up to 30t. 

As pointed out in Sec. II, long-ranged miiucolumnar circuitry across regions and across 
macrocolumns within regions is quite important in the neocortex and this present calculation only 
represents a model of minicolumnar interactions within a macrocolumn. Therefore, only the first few t 
foldings should be considered as having much physical significance. 

Figure 3(a) shows the evolution of model BC' after 100 foldings of At = 0.01, or one unit of 
relaxation time r. Note the existence of ten well developed peaks or possible trappings of firing patterns. 
The peaks more distant from the center of firing space would be even smaller if the actual nonlinear 
diffusions were used, since they are smaller at the boundaries, increasing the Lagrangian and diminishing 
the probability distribution. However, there still are two obvious scales. If both scales are able to be 
accessed then all peaks are available to process patterns, but if only the larger peaks are accessible, then 
the capacity of this memory system is accordingly decreased. This seems to be able to describe the 
"7 ±2" rule. Figure 3(b) shows the evolution after 500 foldings at 5t; note that the integrity of the 
different patterns is still present. Figure 3(c) shows the evolution after 1000 foldings at IOt; note the 
deterioration of the patterns. Figure 3(d) shows the evolution after 3000 foldings at 30t; note that while 
the original central peak has survived, now most of the other peaks have been absorbed into the central 
peaks and the attractors at the boundary. 

Figure 4(a) shows the evolution of model EC' after 100 foldings of Af = 0. 01, or one unit of 
relaxation time t. Note that, while ten peaks were present at this time for model BC, now there are only 
four well developed peaks, of which only two are quite strong. Figure 4(b) shows the evolution after 1000 
foldings at IOt; note that only the two previously prominent peaks are now barely distinguishable. 
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Figure 5(a) shows the evolution of model IC after 100 foldings of A? = 0.01, or one unit of 
relaxation time r. While similar to model BC, here too there are ten peaks within the interior of firing 
space. However, quite contrary to that model, here the central peaks are much smaller and therefore less 
likely than the middle and the outer peaks (the outer ones prone to being diminished if nonlinear 
diffusions were used, as commented on above), suggesting that the original stimulus pattern at the origin 
caimot be strongly contained. Figure 5(b) shows the evolution after 100 foldings at IOt; note that only 
the attractors at the boundaries are still represented. 

Figure 6(a) shows the evolution of model BC'_V1S after 100 foldings of At = 0. 01, or one unit of 
relaxation time t. In comparison to model BC, this model exhibits only six interior peaks, with three 
scales of relative importance. If all scales are able to be accessed, then all peaks are available to process 
patterns, but if only the larger peaks are accessible, then the capacity of this memory system is 
accordingly decreased. This seems to be able to describe the "4 + 2" rule for visual memory. Figure 6(b) 
shows the evolution after 100 foldings at lOr; note that these peaks are still strongly represented. Also 
note that now other peaks at lower scales are clearly present, numbering on the same order as in the BC 
model, as the strength in the original peaks dissipates throughout firing space, but these are much smaller 
and therefore much less probable to be accessed. As seen in Fig. 6c, similar to the BC model, by 15t, 
only the original two large peaks remain prominent. 

rV. CONCLUSION 

Experimental EEG results are available for regional interactions and the evidence supports 
attractors that can be considered to process short-term memory under conditions of selective attention. 
There are many models of nonlinear phenomena that can be brought to bear to study these results. 

There is not much experimental data available for large-scale minicolumnar interactions. However, 
SMNI offers a theoretical approach, based on experimental data at finer synaptic and neuronal scales, that 
develops attractors that are consistent with short-term memory capacity. The duration and the stability of 
such attractors likely are quite dependent on minicolumnar circuitry at regional scales, and further study 
will require more intensive calculations than presented here [16]. 

We have presented a reasonable paradigm of multiple scales of interactions of the neocortex under 
conditions of selective attention. Presently, global scales are better represented experimentally, but the 
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mesoscopic scales are represented in more detail theoretically. We have offered a theoretical approach to 
consistently address these multiple scales [14-16], and more a phenomenological macroscopic 
theory [28-32] that is more easily compared with macroscopic data. We expect that future experimental 
efforts will offer more knowledge of the neocortex at these multiple scales as well. 
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FIGURE CAPTIONS 

FIG. 1 . Magnitude (upper) and phase (lower) at 9 Hz of 1 sec of alpha rhythm is shown. The plots 
represent estimates of potential on the cortical surface calculated from a 64 channel scalp recording 
(average center-to center electrode spacing of about 2.7 cm). The estimates of cortical potential wave 
forms were obtained by calculating spatial sphne functions at each time slice to obtain analytic fits to 
scalp potential distributions. Surface Laplacian wave forms were obtained from second spatial derivatives 
(in the two surface tangent coordinates). Magnitude and phase were obtained from temporal Fourier 
transforms of the Laplacian wave forms. This particular Laplacian algorithm yields estimates of cortical 
potential that are similar to inverse solutions based on four concentric spheres modes of the head. The 
Laplacian appears to be robust with respect to noise and head model errors [36]. The dark and the lighter 
shaded regions are 90° out of phase, suggesting quasi-stable phase structure with regions separated by a 
few centimeters 180° out of phase (possible standing waves). Data recorded at the Swinburne Centre for 
Applied Neurosciences in Melbourne, Austraha. 

FIG. 2. Changes of alpha rhythm correlation coefficients based on comparisons of magnitude (solid 
line) and phase (dashed line) plots of successive 1-sec epochs of alpha rhythm compared with spatial 
templates based on averages over 3 min of data (similar to Fig. 1). The data show a quasistable structure 
with major changes in magnitude or phase about every 6 sec, after which the structure tends to return to 
the template structure. 

FIG. 3. Model BC: (a) the evolution at t, (b) the evolution at 5t, (c) the evolution at IOt, and (d) 
the evolution at 30t. 

FIG. 4. Model EC': (a) the evolution at r and (b) the evolution at lOr. 

FIG. 5. Model IC: (a) the evolution at t and (b) the evolution at IOt. 

FIG. 6. Model BC'_VIS: (a) the evolution at z, (b) the evolution at IOt, and (c) the evolution at 

15t. 
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Figure 2 
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Figure 3a 
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Figure 3b 
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Figure 3c 
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Figure 3d 
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Figure 4b 
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Figure 5a 
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Figure 5b 
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Figure 6a 
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Figure 6b 
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Figure 6c 
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